Shannon Meets Carnot: Mutual Information Via Thermodynamics
نویسندگان
چکیده
In this contribution, the Gaussian channel is represented as an equivalent thermal system allowing to express its input-output mutual information in terms of thermodynamic quantities. This thermodynamic description of the mutual information is based upon a generalization of the 2 thermodynamic law and provides an alternative proof to the Guo-Shamai-Verdú theorem, giving an intriguing connection between this remarkable theorem and the most fundamental laws of nature the laws of thermodynamics.
منابع مشابه
Quantum Information Chapter 10. Quantum Shannon Theory
Contents 10 Quantum Shannon Theory 1 10.1 Shannon for Dummies 2 10.1.1 Shannon entropy and data compression 2 10.1.2 Joint typicality, conditional entropy, and mutual information 6 10.1.3 Distributed source coding 8 10.1.4 The noisy channel coding theorem 9 10.2 Von Neumann Entropy 16 10.2.1 Mathematical properties of H(ρ) 18 10.2.2 Mixing, measurement, and entropy 20 10.2.3 Strong subadditivit...
متن کاملCarnot in the Information Age: Discrete Symmetric Channels
Modeling communication channels as thermal systems results in Hamiltonians which are an explicit function of the temperature. The first two authors have recently generalized the second thermodynamic law to encompass systems with temperature-dependent energy levels, dQ = TdS+ < dE/dT > dT , where < · > denotes averaging over the Boltzmann distribution, recomputing the mutual information and othe...
متن کاملThermodynamics Meets Special Relativity – or What Is Real in Physics?
In this paper we carefully reexamine the various framworks existing in the field of relativistic thermodynamics. We scrutinize in particular the different conceptual foundations of notions like the relativistic work, heat force, moving heat and relativistic temperature. As to the latter notion we argue that, as in ordinary thermodynamics, relativistic absolute temperature should be introduced o...
متن کاملThe Second Law and Informatics
A unification of thermodynamics and information theory is proposed. It is argued that similarly to the randomness due to collisions in thermal systems, the quenched randomness that exists in data files in informatics systems contributes to entropy. Therefore, it is possible to define equilibrium and to calculate temperature for informatics systems. The obtained temperature yields correctly the ...
متن کاملSecond law of thermodynamics with discrete quantum feedback control.
A new thermodynamic inequality is derived which leads to the maximum work that can be extracted from multi-heat-baths with the assistance of discrete quantum feedback control. The maximum work is determined by the free-energy difference and a generalized mutual information content between the thermodynamic system and the feedback controller. This maximum work can exceed that in conventional the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/0806.3133 شماره
صفحات -
تاریخ انتشار 2008